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[57] ABSTRACT 

A picture signal encoding apparatus on which, even if a 
picture is not uniform in picture pattern, the picture can be 
rendered substantially uniform in picture quality, the volume 
of bits occupying a virtual buffer is stabilized, deterioration 
in picture quality is rendered less visible and in which stable 
rate control is assured. The picture signal encoding 
apparatus, dividing a picture making up moving picture 
signals into plural macro-blocks MB and encoding the 
signals from one macro -block to another, includes a relative 
coding difiBculty calculating circuit for calculating the rela- 
tive coding difiBculty from one macro-block to another MB, 
and a characteristic value calculating circuit for calculating 
the weighting coefiBcients (characteristic values) specifying 
visibility degree of picture quality deterioration from one 
macro-block MB to another. The picture signal encoding 
apparatus also includes a bit rate controller for calculating 
the quantization scale for encoding each macro -block MB 
using the complexity degree and the volume of allocated bits 
for macro-block-based encoding. 
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QUANTIZATION MATRIX 
FOR INTRA-CODING 

ml [u, V] = { 

8, 16, 19, 22, 26, 27, 29, 34, 

16, 16, 22, 24, 27, 29, 34, 37, 

19, 22, 26, 27, 29, 34, 34, 38 , 

22 , 22 , 26 , 27 , 29 , 34 , 37 , 40 , 

22 , 26 , 27 , 29 , 32 , 35 , 40 , 48 , 

25 , 27 , 29 , 32 , 35 , 40 , 48 , 58 , 

26 , 27 , 29 , 34 , 38 , 46 , 56 , 69 , 

27 , 29 , 35 , 38 , 46 , 56 , 69 , 83 } : 



FIG.7A 



QUANTIZATION MATRIX 
FOR INTER-CODING 

m2 [u, V] = { 

16, 16, 16, 16, 16, 16, 16, 16 , 
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16, 16, 16, 16, 16, 16, 16, 16 , 
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1 

PICTURE SIGNAL ENCODING METHOD 
AND APPARATUS AND SIGNAL 
RECORDING MEDIUM 

BACKGROUND OF THE INVENTION 

L Field of the Invention 

This invention relates to a picture signal encoding method 
or apparatus used in a system for encoding picture signals 
for moving pictures for storage on a recording medium, such 
as an optical disc, a magnetic disc or a magnetic tape or in 
a system for transmitting picture signals of moving pictures 
over a transmission route. This invention also relates to a 
signal recording medium used in these systems. 

2. Description of Related Art 

In general, digital video signals are extremely large in 
information volume. Therefore, if it is attempted to record 
the digital video signals for prolonged lime on a small-sized 
recording medium with a small storage information volume 
(storage capacity), or to transmit the digital video signals 
over a transmission channel of limited communication 
capacity, it is indispensable to encode the digital video 
signals by high eflBciency encoding in order to reduce the 
information volume. For meeting this demand, there are 
proposed high eflBciency encoding systems exploiting the 
correlation of video signals. One of these systems is the 
Moving Picture Exerts Group (MPEG) system, in which the 
inter-frame difference is taken of video signals to lower 
redundancy along time axis and subsequently the orthogonal 
transform technique such as discrete cosine transform 
(DOT) is used to lower redundancy along the spatial axis for 
efiBciently encoding the video signals. 

With the MPEG system, the pictures making up a moving 
picture are classified into three sorts of pictures, namely 
I-pictures, P-picture or B -pictures, for compression coding 
of picture signals, as shown in FIG. 1. The I -picture is an 
intra-coded picture and is decoded independently of other 
pictures, llie P-picture is a forward predictive coded picture 
obtained on prediction coding from the temporally backward 
or past I- or P-pictures. The B-picture is a bi-directional 
predictive coded picture obtained on predictive coding from 
forward, backward or bi-directional pictures using a tempo- 
rally forward or backward I- or P-picture. A set of these 
pictures constitutes so-called group-of-pictures (GOP), 

Each picture is divided into smaller units termed macro- 
blocks. In the case of, for example, a 4:2:0 format digital 
video, each macro-block MB is made up of six blocks, 
namely four luminance blocks (^i*; and two spatially asso- 
ciated chrominance blocks Cb and Cr. Each of these blocks 
is made up of 8 by 8 pixels, totahng at 64 pixels. 

If the number of pixels in the horizontal direction of the 
luminance signals is PH, the number MBH of the macro- 
blocks of a picture in the horizontal direction is given by the 
following equation (1): 

Mfi//-(P//+15)/16 (1) 

On the other hand, if the number of pixels in the vertical 
direction of the luminance signals is PV, the number MBV 
in the vertical direction of a picture of an interlaced frame 
(with a flag defined by MPEG2 progressive_sequence=0) is 
given by the following equation (2): 

MBV~2'({PV+31)m) (2) 
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2 

The number NMB in a picture is found from the following 
equation (3): 

NMB-MBH'MBV (3) 

^ FIG. 2 shows the coding sequence of each macro-block 
MB in an I -picture. That is, the macro-blocks MB in the 
I -picture are encoded sequentially (in the order specified by 
numerical figures entered in FIG. 2) beginning from the first 
or upper left macro-block up to the NMBth macro-block 
MB, as shown in FIG. 2. 

^0 In the MPEG coding system, the numbers of allocated bits 
are preferably varied adaptively from picture to picture for 
taking advantage of the performance of the three sorts of 
pictures (I- P- or B-pictures) of different properties. Also, in 
the MPEG coding system, the quantization scale for quan- 

35 tization of DOT coeflBcients of a macro-block MB can be 
varied from one macro-block MB to another for performing 
bit rate control so that the volume of generated bits of a 
coded picture will approach a designated amount of allo- 
cated bits. 

20 Among widely known systems for controlling the quan- 
tization scale of a macro-block MB is a system disclosed in 
ISO/IEC JTC1/SC29AVG11/N0400 test Model 5, pp. 54 to 
57 (April 1993). The corresponding technical information is 
afforded by, for example, U.S. Pat. No. 5,144,424 entitled 

25 APPARATUS FOR VIDEO DATA QUANTIZATION 
CONTROL. ITie control system for controlling the quanti- 
zation scale of this macro-block MB is hereinafter termed 
TM5 rate control. 

FIG. 3 shows a flowchart for this TM5 rate control. 

30 In FIG. 3, assume that the number of pictures in a video 
sequence is NPICT and a variable specifying a picture for 
calculating the volume of allocated bits among the pictures 
of the sequence is pict_i. That is, the flowchart of FIG. 3 
shows the flow for calculation of the volume of allocated bits 

35 for the pict-ith one of the pictures in the sequence. The 
volume of aUocated bits for the pict_ith picture is BT. In the 
following explanation, each variable is described by the C++ 
language as one of programming languages. 

First, at step ST51, the variable pict__i is set to 1 as a 

40 picture for calculating the volume of allocated bits for 
specifying the first picture in the sequence. 

After this step ST51, the above variable pict_i is sequen- 
tially incremented by 1 in the processing from step ST52 to 
step ST63 for calculating the volume of allocated bits in 

45 each picture in the sequence. The processing from step ST51 
up to step ST64 is repeated until the calculations of the 
volume of allocated bits come to a close for all pictures in 
the sequence. 

For this processing from step ST52 up to step S T63, the 
50 volume of allocated bits BT for the pict_ith picture is first 
calculated at step ST52. First, parameters specifying picture 
complexity degree are calculated from one picture type to 
another, and the volume of allocated bits of the GOP is 
allotted by proportionate distribution to each picture depend- 
55 ing on the picture complexity degree. 

At the steps ST53 and ST54 to ST60, the quantization 
scale of each macro-block in the pict_ith picture is calcu- 
lated. Here, the variable specifying the macro-block MB in 
which the quantization scale is calculated in the pict_ith 
60 picture is set as mb_i. 

At step ST53, of the above steps ST53 up to ST60, the 
above variable mb_i as the macro-block MB in the pict„ith 
picture, in which to execute the calculations for the quan- 
tization scale, is set to 1 for designating the first macro-block 
65 in the picture. 

After this step ST53, the above variable mb_i is sequen- 
tially incremented by 1 in the processing from step ST54 up 
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to Step ST60, for calculating the quantization scale in each In each of the above equations, (BT*mb_i/NMB) denotes 

macro-block MB in the picture. The processing from ST54 a value obtained on allocating the volume of bits BT 

to step ST60 is repeated until the calculations of the quan- allocated to a given picture to mb_i macro-blocks MB 

tization scale for all macro-blocks MB in the picture come among the total number of macro -blocks NMB of the 

to a close. 5 picture. 

As the processing from ST54 to step ST60, the total At step ST59, the address of the macro-block MB is 

volume of the quantization scale in a picture under consid- advanced by one. That is, the above variable mb_i is 

e ration is calculated, from the volume of bits occupying the incremented. 

virtual buffer, in accordance with the following equation (4): At the next step ST60, it is judged whether or not 

10 processing of the last macro-block of the pict^Jth picture 
GQ^mb_i]*3yr (4) ^.Q^g ^ ^.j^^^^ jjj^j ^ whether or not the variable mb__i 

where GQ is the global quantization scale. ^. the number of macro-blocks NMB in the 

In the above equation, d[mb i] is the volume of bits f^^^l^.^'/f ^he result is negative, that is if processmg is not 
occupying the virtual buffer prioTto coding of the mb ith processing reverts to step ST54. If the result is 

macro-block MB, and r (termed a reaction parameter) il of ^^^^''^^^ ^ if processing has been terminated, pro- 

aconstantvaluepertinenttothetargetbitrateandthepicture ce^jng transfers to the next step ST61. 

rate. The larger the volume of bits occupying the virtual , '^"P ^J"' ^^"^^.^^ Pf ^ incremented by 

buffer, the larger is the above global quantization scale GQ. ^ f°^" ^ "11? '° Processing the next picture. 

Meanwhile,thecalculationsoflhevolumeofbitsoccupying ^ ''Z^^l' ^^ ^^^IZu ^"^^^^ 

the virtual buffer will be explained subsequently in connec buffers dI[NMB+l], dP[NMB+l] and dB[NMB+l] at the 

tion with the steo ST58 ^ ^ time of end or the above -described picture encoding are 

VT * 4 . OT-M • u*- «r ' * « 1 • • * substituted for the volume of bits occupying the virtual 

Next, at step ST55, a weightmg coeflScient W taking mto . rr ,,r, n .^m j jr»rn * ■ • i i c 

account the visual characteristic of the mb ith macro- ^/^^^"^ ^^^^}' '^^^^ "^l^: ^'^ ""'^'^ 

block MB is calculated from the following equation (5): '^^ occupying bits of the virtual buffers are updated as 

® ^ ^ ' 25 shown by the equations (11) to (13): 

dI[l]~dJ[NMB+l] (11) 

dF[l}=^NMB+l] (12) 



W^-(ffc4mfci_/}+2 'a vg_act)/{2 *ac^mb_i}¥avg_act) (5) 

In the equation (5), act[mb_i is a minimum value of the 
variance of four luminance signal blocks of the macro-block 



MB. This value specifies picture pattern complexity degree 30 dB[iHB[JVA/fi+i] (13) 

of the luminance signals. The larger this value, the more 

complex is the picture pattern. In the above equation. At the next step ST63, it is judged whether or not 
avg^act is a mean value of acl[mb_i]. In a flat portion processing of the last picture of the sequence (with the 
where deterioration is perceptually acute, the weighting number of pictures of NPICT) has come to a close. 
coefiBcient becomes larger. Conversely, in a picture portion 35 Specifically, it is judged whether or not the variable pict__i 
with complex picture patterns, where deterioration is per- is larger than the number of pictures NPICT of the sequence, 
ceptually less acute, the weighting coefficient W becomes If the result of judgment is negative, that is if processing has 
smaller. The weighting coefficient W is normalized so that not come to a close, processing reverts to step ST52 and, if 
its value ranges from V2 to 2 and an expected value of W in otherwise, that is if processing has come to a close, pro- 
the I -picture will be equal to 1. 40 cessing of TM5 rate control comes to a close. 

At the next step ST56, the quantization scale mQ of the Meanwhile, when calculating the quantization scale of the 
mb_ith macro-block MB is calculated in accordance with current macro-block MB in the above TM5 rate control, the 
the following equation (6): quantization scale GQ is calculated from the current volume 

of bits occupying the virtual buffer as shown by the above 
mQ=GQAV (6) 45 equation (4). The global quantization scale GQ is calculated 

At the next step ST57. the DCT coefficients of the mb ith ^^^j^^ '^^ ''"^'""^ °^''^!^ occupying the virtual buffer 

macro-block MB are quantized and encoded for thereby ^^?'!'"^'^ ^7'!^ "^l^ equations (7) to (9). That feed- 
calculating the volume of actually generated bits bit mb »PPl^«d ^^^h 'hat >f the volume of generated bits of 
[mb il of the mb ith macro-block MB. ? "^7^1? u"^^™^'^ ° Tu ° u"* °f 

AUhe next step ST58, the volume of bits occupying the '° """'^.f "P '° now (BT«mb_j^B) such that the volume 
virtual buffer is updated, dl, dP and dB are provided for the °J ""^ occupying the virtual buffer is decreased (that is 
I-, P- and B-picture. respectively, and are updated in accor- ^"^"t.)' '^e global quantization scale GQ is 

dance with the following equations (7) to (9): diminished from the equation (4) whereby the volume of 

^ ^ V / V / generated bits of the macro-block MB is increased to 

dJ[mb^i+'i]^i}+BG[mb_j}BT*mb_i/NMB (7) 55 Stabilize the volume of bits occupying the virtual buffers. If 

reverse is the case, that is if the volume of bits occupying the 
dF[mb_i+i}«dF[i]+BG{mb_i}BT^mb_i/NMB (8) virmal buffer is increased in its value, there is applied such 

wor t, • n ^orn ». i ut* -.kjx^o rc^^ feedback that the global quantization scale GQ is increased 

dB{mb_i'k-\\^[AY^G[mb_i\BT*mb_ilNMB (9) i r .jl-. c iif 

to diminish the volume of generated bits of the macro-block 
In the above equations, dl[l], dP[l] and dB[l] denote the *o stabilize the volume of bits occupying the virtual 

volume of bits initially occupying each virtual buffer and buffers. This feedback control assures uniform volume of 
BG[mb_i] denotes the sum of generated encoding bits bits generated in the pictures. 

bit_mb from the first macro-block MB up to the mb_ith However, this control raises a problem if the picture is not 
macro-block MB of the picmre, as shown in the following uniform in pattern, for example, if the picture contents differ 
equation (10): 65 in the upper and lower halves, such that the upper half is of 

a simple picture pattern whereas the lower half is complex 
BG[mbUiyn}it_miAf^b_i\ {i'>\'~mb_i) (10) in picOire pattern. That is, since feedback is applied such that 
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the volume of generated bits in the upper half will be equal 
to that in the lower half, the upper haLf picture is quantized 
finely, while the lower picture half is quantized roughly, with 
the result that the picture quality is not uniforna. There is also 
raised a problem that when the macro-block MB transfers 5 
from the upper half picture to the lower half picture, the 
volume of bits occupying the virtual buffers tends to be 
non-stable. 

Moreover, in the above TM5 rate control, the weighting 
coefiGcients taking into account the visual characteristics of lo 
the macro-blocks MB are calculated from the flatness of the 
luminance signals. This, however, is insufiEcient if desired to 
render deterioration in picture quality less acute. 

In addition, in the TM5 rate control, stable rate control is 
not assured if the weighting coefiScients W are not normal- is 
ized so that the expected value in the 1-picture of the 
weighting coefiScients W taking into account the visual 
characteristics will be equal to 1. For example, assume that 
the quantization scale mQ indicated by numerical figures in 
FIG. 4 has been calculated in each macro-block MB, 20 
wherein smaller and larger values of the numerical figures 
stand for fine quantization and rough quantization, respec- 
tively. Also assume that, in this case, it is desired to reduce 
the quantization scale of the macro-blocks shown shaded in 
FIG. 4A, and the weighting coefiScients only of the macro- 25 
blocks shown shaded in FIG. 4A are increased. Since the 
expected value of the weighting coefficients ceases to be 
equal to 1, only the quantization scale calculated for the 
macro-blocks following the macro-blocks shown shaded in 
FIG. 4B is increased. 30 

In the TM5 rate control, since the weighting coefficients 
W for flatness of the macro-blocks MB are normalized 
relative to an average value of the flatness of the I-picture in 
calculations, the expected value of the weighting coefiScients 
W is 1. However, if the weighting coefiGcients W are 35 
absolutely designated for the parameters taking into accotmt 
visual characteristics of the macro-block MB, such that the 
expected value of the weighting coefiGcients W ceases to be 
1. stable rate control is not ussured. 

SUMMARY OF THE INVENTION 

It is therefore an object of the present invention to provide 
a picture signal encoding method and apparatus and a signal 
recording medium in which a picture having non-uniform 
pattern can be rendered substantially constant in picture 45 
quality, the volume of bits occupying a virtual buflfer can be 
stabilized, picture quality deterioration can be rendered less 
acute and in which the stable rate control is assured. 

In one aspect, the present invention provides a method for 
encoding picture signals in which moving picture signals are 50 
divided into plural domains for encoding from one domain 
to another, including calculating relative coding diflGculty 
from domain to domain, calculating weighting coefiGcients 
representing the degree of visibility of picture quality dete- 
rioration from domain to domain, calculating the complexity 55 
degree from domain to domain, based on the relative coding 
difiSculty and the weighting coefiGcients and calculating the 
quantization scale for encoding for the domains based on the 
complexity degree and the allocated bit volumes for encod- 
ing the domains. 60 

In calculating the quantization scale, the volume of bits 
allocated to each domain is calculated in proportion to the 
complexity degree of each domain relative to complexity of 
the entire picture. The relative coding difiQculty is calculated 
using the volume of codes generated on encoding each 65 
domain with a fixed quantization scale, the volume of 
predicted remainder signals at the time of detecting the 
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motion vector of each domain or the difference residual 
volume from a mean value of each domain. The weighting 
coefiGcients are calculated based on the combination of at 
least one of the lightness, redness, amount of motion and the 
position of each domain in the picture, in addition to the 
flatness of the luminance signals of the moving picture. The 
encoded data string of the picture obtained on this encoding 
is transmitted or recorded. 

In another aspect, the present invention provides a record- 
ing medium having recorded thereon an encoded data string 
obtained on calculating, for each of plural domains into 
which is divided a picture making up moving picture signals, 
the relative coding diflGculty and weighting coeflicients 
representing the visibility degree of picture quality 
deterioration, calculating the complexity degree from the 
relative coding difiGculty and the weighting coefiGcients, 
calculating the quantization scale of encoding for each 
domain based on the volume of allocated bits for encoding 
each domain and complexity degree and on encoding each 
domain based on the quantization scale. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates typical results of calculations of a 
MPEG data structure. 

FIG. 2 iUustrates the coding sequence of the macro-blocks 
MB in a picture. 

FIG. 3 is a flowchart showing the flow of calculations of 
the quantization scale of the macro-block MB by TM5 
system rate control. 

FIGS. 4A and 4B illustrate typical results of calculations 
of the quantization scale of the macro-blocks MB of a 
picture by a conventional method. 

FIG. 5 is a block circuit diagram showing a first embodi- 
ment of a picture signal encoding device according to the 
present invention. 

FIG. 6 is a block circuit diagram showing an illustrative 
stpjcture of a moving picture encoding circuit. 

FIGS. 7A and 7B illustrate quantization matrices for 
intra-coding and inter-coding, respectively. 

FIG, 8 is a block circuit diagram showing an illustrative 
structure of an relative coding difiGculty calculating circuit. 

FIG. 9 is a block circuit diagram showing a second 
embodiment of a picture signal encoding device according 
to the present invention. 

FIG. 10 is a graph for illustrating a function fl between 
coefiScients a and flatness F of luminance signals of the 
macro-block MB. 

FIG. 11 is a graph for illustrating a function £2 between 
coefiGcients P and lightness L (mean value) of luminance 
signals of the macro -block MB. 

FIG. 12 is a graph for illustrating a function 13 between 
coefiScients 7 and redness R of the macro-block MB. 

FIG. 13 is a graph for illustrating a function f4 between 
coeCQcienLs 6 and the amount of motion M of the macro- 
block MB. 

FIG. 14 is a graph for illustrating a function f5 between 
coefiGcients e and a position P of the macro-block MB in a 
picture. 

FIG. 15 is a flowchart showing the flow of calculations for 
the first path for calculating the first path for calculating the 
quantization scale of the macro-block MB by bit rale control 
embodying the invention. 

FIG. 16 is a flowchart for illustrating the flow of calcu- 
lations for the second path in calculating the quantization 
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scale of the macro-block MB in the bit rate control embody- 
ing the invention. 

FIG. 17 illustrates typical results of calculations of the 
quantization scale of the macro-block MB of a picture in the 
picture signal encoding method of the present invention. 

DESCRIPTION OF PREFERRED 
EMBODIMENTS 

Referring to the drawings, preferred embodiments of a 
picture signals encoding method and apparatus and a signal 
recording medium according to the present invention will be 
explained in detail. 

FIG. 5 shows a first embodiment of a picture signal 
encoding device of the present invention. 

In FIG. 5 a digital moving picture signal SIO entering a 
terminal 100 is sent to a motion vector detection circuit 101 
and to a delay circuit 102 as later explained. Since the digital 
moving picture signal 810 is processed as from this time 
from one macro-block MB to another, this signal SIO is 
termed input MB signal. 

The motion vector detection circuit 101 calculates the 
motion vector MV on the macro-block basis from the digital 
moving picture signal SIO. This motion vector detection is 
by pattern matching between a reference frame and the 
current macro-block MB. That is, a sum Ef of absolute 
values of differences between a signal A[ij] of the current 
macro-block signal MB and a signal F[i j] of a macro-block 
referred by an optional motion vector: 

Ef''-S:\A[i,j]-F[i,j]\ (i=0 /o 15, >=0 to 1 5) (1 4) 

The motion vector detection circuit 101 outputs a motion 
vector which gives the smallest value of Ef as a motion 
vector signal MV. 

The input MB signal SIO and its macro -block based 
motion vector MV are sent to a relative coding difEculty 
calculating circuit 107 where the relative coding diflSculty 
dft„mb of the input MB signal SIO is calculated. The 
relative coding difiBculty is a parameter specifying the 
MB-based volume of the input MB signal SIO. An illustra- 
tive structure of the relative coding difficulty calculating 
circuit 107 will be explained subsequently. The relative 
coding diflSculty dft_mb is sent to a bit rate controller 104. 

The input MB signal SIO and its macro-block based 
motion vector MV are sent to a characteristic value calcu- 
lating circuit 103 where a weighting coefficient weight_mb 
of the input MB signal taking into account the visual 
characteristics are calculated. The weighting coefficient 
weight_mb is a parameter representing the degree of vis- 
ibility of deterioration due to coding. The characteristic 
value calculating circuit 103 will be explained subsequently. 
The weighting coefficient weight_mb is sent to the bit rate 
controller 104. 

On the other hand, the input MB signal and its macro- 
block based motion vector MV are delayed by the delay 
circuit 102, until the quantization scale mQ of the macro- 
block MB is outputted by the bit rate controller 104, before 
being supplied to a motion vector coding circuit 105. The 
digital motion vector signal delayed by the delay circuit 102 
is termed hereinafter an input MB signal Sll for distinction 
from the input MB signal. The input MB signal Sll out- 
putted by the delay circuit 102 is encoded by the moving 
picture encoding circuit 105 to generate a coded bitstream 
which is outputted at an output terminal 106. The volume of 
the encoded generated bits bit_mb, calculated by the mov- 
ing picture encoding circuit 105, is sent to the bit rate 
controller 104 which will be explained in detail subse- 
quently. 
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FIG. 6 shows an illustrative structure of a moving picture 
encoding circuit 105. This moving picture encoding circuit 
105 executes hybrid encoding which is a combination of 
motion-compensated inter-frame prediction and DOT. 

In FIG. 6, the input MB signal Sll from the delay circuit 
102 of FIG. 1 is supplied to a terminal 12, whilst the 
macro-block based motion vector MV, delayed by the delay 
circuit 102, is supplied to a terminal 13. The input MB signal 
Sll and the associated motion vector MV are entered to a 
motion compensation circuit 20. 

The motion compensation circuit 20 includes a picture 
memory from which the macro-block based prediction pic- 
ture signal MB, referred to hereinafter as prediction MB 
signal, is read out. The sura of absolute values of the 
macro-block based difference between the input MB signal 
and the prediction MB signal is compared to the sum of 
absolute values of the differences from the mean value of the 
input MB signal. If the former or the latter is found to be 
smaller, the inter <oding mode or the intra-coding mode is 
set, respectively. If the picture is an I-picture, all macro- 
blocks MB are set to the intra-coding mode. The motion 
compensation circuit 20 outputs the prediction MB signal as 
a signal S12, if the coding mode is the inter-coding mode, 
while outputting all-zero signals of the macro-block MB as 
a signal S12 if the coding mode is the intra-coding mode. 

An arithmetic unit 14 adds the input MB signal Sll as an 
addition signal and the above signal S12 as a subtraction 
signal from one macro-block to another to find the difference 
between the input MB signal Sll and the signal S12 to 
30 output the resulting difference as a predicted remainder MB 
signal S13. 

The predicted remainder MB signal S13 is then sent to a 
DCT circuit 15 which then performs the 8x8-pixel two- 
dimensional DCTon the predicted remainder MB signal S13 
on the block basis to output the resulting DCT coefficients 
S14. These DCT coefficients S14 are sent to a quantization 
circuit 16. 

The quantization circuit 16 then quantizes the DCT coef- 
ficients based on the quantization scale mQ supplied via 
terminal 11 from the bit rate controller 104 of FIG. 5 and the 
intra/inter prediction mode determined by the motion com- 
pensation circuit 20 in order to quantize the DCT coefficients 
as follows: 

If the mode is the intra-coding mode, 
DC coefficients 



20 



25 



35 



40 



50 



55 



ilCOMO^Oj'/S 



ilu,v}«16*c[u,v]//(mQ*ml[u,vJ) 

If the mode is the inter-coding mode, 
i{u, v]-l 6 *c(u, v]/{mQ *m2[u, v]) 



(15) 



(16) 



(17) 



60 



65 



In the above equations, c[u,v] (u=0 to 7 and v«0 to 7) are 
input DCT coefficients and i[u,v] are the quantized DCT 
coefficients. Also, in the above equations, ml[u,v] denotes a 
quantization matrix for intra-coding and m2[u,v] denotes a 
quantization matrix for inter-coding. FIGS. 7 A, 7B show 
examples of the quantization matrix ml[u,v] for intra- 
coding and the quantization matrix m2[u,v] for inter-coding, 
respectively. In the above equations, symbols // and / denote 
integer division for rounding to the nearest integer and an 
integer division with rounding off for approaching the result 
towards 0, respectively. 
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The quantized output signal of the quantization circuit 16 
and the associated motion vector MV are sent to a variable- 
length encoding circuit (VLC) 21. The VLC 21 variable- 
length encodes the quantized output signal and the motion 
vector MV based on the MPEG syntax. 5 

The signal obtained by this variable length coding is sent 
to a buffer memory 23. This buffer memory 23 smoothes 
variations in the volume of generated bits during a short time 
period from the VLC 21 to output a coded bitstream of the 
target bitrate. The coded bitstream outputled by the buffer lO 
memory 23 is outputted at a terminal 24 and thence supplied 
to the output terminal 106 of FIG. 5. 

An output signal of the VLC 21 is also sent to a counter 
22 which counts the volume of codes of the output signal of 
the VLC 21 to find the volume of generated codes corre- 15 
spending to the input MB signal to transmit the generated 
code volume as the aforementioned volume of generated 
encoded bits bit_mb to a terminal 10. The volume of 
generated encoded bits bit„mb outputled by this terminal 10 
is sent to the bit rate controller 104. 20 

On the other hand, the quantized output signal and the 
quantization scale of the quantization circuit 16 are sent to 
a dequantization circuit 17 which then dequantizes the 
quantized output signal in association with the above- 
mentioned quantization scale. An output of the dequantiza- 25 
tion circuit 17 is supplied to an inverse DCT circuit 18 for 
inverse DCT and decoding to give prediction remainder MB 
signal which is entered to an arithmetic unit 10. 

This arithmetic unit 19 is fed with the same signal as the 
aforementioned prediction MB signal S15 supplied to the 30 
arithmetic unit 14. The arithmetic unit 19 adds the prediction 
MB signal 812 to the prediction MB signal S15. This gives 
a locally decoded picture signal which is the same signal as 
the output picture on the receiver or decoder side. 

FIG. 8 shows an illustrative structure of the relative 35 
coding difficulty calculating circuit 107 shown in FIG. 5. 
This relative coding difficulty calculating circuit 107 is 
basically the same as the moving picture encoding circuit 
explained with reference to FIG. 6, with the HifTerence being 
that a lixed quantization scale is used in the quantization 40 
circuit 30 and the volume of bits occupied in the buffer is not 
supervised in connection with the volume of generated 
codes from the VLC 31. That is, the volume of generated bits 
from the VLC 31 is counted up by a counter 32 from one 
macro-block MB to another such that relative coding dif- 45 
ference dft_mb is outputted at a terminal 33. In FIG. 8, parts 
or components similar to those of FIG. 2 are denoted by the 
same reference numerals and the corresponding description 
is omitted for simplicity. 

FTG= 9 shows a second embodiment of the picture signal 50 
encoding device of the present invention. 

'ITie present second embodiment of the picture signal 
encoding device differs from the above -described first 
embodiment of the picture signal encoding device as to the 
method of calculating the relative coding difficulty dft_mb 55 
of the macro-block MB. In FIG. 6, parts or components 
similar to those of FIG. 5 are denoted by the same reference 
numerals and the corresponding description is omitted for 
simplicity. 

If, in this second embodiment of the picture signal encod- 60 
ing device of FIG. 9, the input digital moving picture signal 
(input MB signal) S20 is encoded as a P- or B-picture, the 
prediction remainder of the input MB signal S20 from the 
motion vector detection circuit 201, that is the sum Ef of the 
absolute values of the differences calculated by the above 65 
equation (14), is used as the macro-block based relative 
coding difficulty dft_mb. If the input MB signal S20 is 



encoded as an I-picture, the sum of absolute values of the 
differences from the mean value of the input MB signal S20 
calculated by a characteristic value calculating circuit 203 is 
used as the macro-block based relative coding difficulty 
dft^mb. It is also possible to use a variance of the input MB 
signal S20 as the relative coding difficulty dft_mb(intra) of 
the macro-block MB. The bit rate controller 204, supplied 
with the relative coding difficulty dft_mb(inter) or dft_mb 
(intra), will be explained in detail subsequently. The opera- 
tion other than that described above is the same as that for 
the picture signals encoding device explained in connection 
with the first embodiment shown in FIG. 5. The digital 
moving picture signal delayed by the delay circuit 102 is 
indicated as S21 in FIG. 9. 

The operations of the characteristic value calculating 
circuit 103 for the macro-block MB in the picture signal 
encoding device shown in FIG. 5 and the characteristic value 
calculating circuit 203 for the macro-block MB in the 
picture signal encoding device shown in FIG. 9 are next 
explained. These characteristic value calculating circuits 
calculate, as characteristic values of the input MB signal 
(SIO or S20), the flatness F, lightness L, redness (red level) 
R, the amount (magnitude) of motion M and the position of 
the macro-block MB in the picture. 

As the flatness F, the variance values of the luminance 
signals of the macro-block MB, for example, are calculated. 

As the lightness L, a mean value of the luminance signals 
of the macro-block MB, for example, is calculated. 

As the red level (R), the size of the red area in the 
macro-block MB is calculated. For example, the pixel value 
Ci(i,j] of the Cr block of the macro-block MB is compared 
to the pixel value Cb[i,j] of the Circuit board block to 
calculate the red level R counted by the ff-condition of 
equation (18): 

if^(Cr{i,j]>mi)&&(Cr[i,j]<Tm))R++\ (»-0 to 7, ;-0 to 7) (18) 

wherein THl and TH2 denote constant threshold values, In 
the above equation (18), described using the so-called C++ 
language, symbols > and < are relative operators forjudging 
relative magnitude of data, symbols ++ denotes increment 
operators, R++; means incrementing R by 1 and symbols 
&& denotes a logical operator specifying a logical product. 

As the motion value M, the magnitude of the motion 
vector of the macro-block MB is calculated. The weighting 
coefficients p are found by the position of the macro-block 
MB in a picture. 

The above-mentioned characteristic value calculating cir- 
cuit 103 or 203 finds coefficients ai, pi, yi, 6i and ei, 
mapping characteristics of the functions fl to f5 onto 
weighting coefficients rab_weight[i] specifying the relative 
visual perceptibility of deterioration in picture quality to find 
respective weighting coefficients mb_weight[i] by a prod- 
uct of these coefficients: 



CU-/1 



(19) 
(20) 
(21) 
(22) 
(23) 
(24) 



where Fi, Li, Ri, Mi and Pi denote flatness, lightness, red 
level, amount of motion and weighting coefficient of the 
positions of the macro-block MB, respectively. 
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Specified examples of the characteristics of the functions The processing flow for calculating the relative coding 

fl to f5 are explained with reference to FIGS. 10 to 14. difficulty dft„mb and the weighting coeflBcients weight__mb 

FIG. 10 shows characteristics of a function fl describing of the macro-block MB and determining the quantization 

the relation between the flatness (variance) of luminance scale of the macro-block MB by the bit rate controller 104 
signals of the macro-block MB and the function fl of the 5 or 204 is hereinafter explained. The bit rate control carried 

coefficients a. In FIG. 10, the abscissa denotes F with 0 out by the bit rate controller 104 or 204 is of two paths, 

denoting complete flatness and MAX denoting a most FIGS. 15 and 16 show the operation of the first and second 

random picture pattern. In general, the human eye can paths, respectively. 

recognize the encoding noise in the flat portion of a picture The operation of the first path shown in FIG. 15 is aimed 
pattern, while it can hardly recognize deterioration in the at searching the complexity degree x_mb of the macro- 
random pattern portion of the picture. Based on this feature, block MB of the input moving picture signal, 
the coefficient a is increased for lower flatness F and At step ST71 of FIG. IS, the variable pict_i is set to 1 for 
decreased towards higher flatness F. designating the first picture in the sequence as being a 
FIG. 11 shows characteristics of a function f2 specifying picture processed for the first path. This designates the initial 
the coefficient p against lightness (mean value) L of lumi- picture among the pictures of the sequence. 

nance signals of the macro-block MB. The lightness L on the After this step ST71, the variable pict i is incremented 

abscissa of FIG. 11 denotes that 0 and MAX stand for black each time processing goes through the steps ST72 to ST79 

and the lightest value, respectively. In general, the human for processing each picture in the sequence by the first-path 

eye can easily recognize the encoding noise. In a dark processing, llie processing from this step S172 to step ST79 

picture for darkness beyond a certain level, however, the ^ repeated until the first-path processing of each macro- 
encoding noise can hardly be perceived because of excessive 20 block of aU pictures in the sequence comes to a close, 

darkness. Based on this feanire, the coefficient p is set to 1 St^J^^ J^^P ?T72 of the processing from step ST72 to 

in the vicinity of Ughtness L=0. The coefficient p is set to ^^^P ^T^,\ the above variable mb 1 is set to 1 as the 

have a peak value at the level of lightness L which most [P''^'^:^^.?,^*' processed by the first path processing in 

readily permits the deterioration to be perceived, with the lictir''''' the first macro-block MB 
coefficient P being graduaUy decreased for larger values of 25 ' ^J^'^^^ ^^^^ ^^^^ ^^^^ ^^^.^^^^ ^^^^ 

^ ^^^^ . . . ^ . , . . . mented each time the processing goes through the steps 
HG. 12 shows characteristics of the relation between the 3^73 to ST77 for processing the macro-blocks MB in the 
red level R of the macro-block MB and a function f3 of the picture for all macro-blocks MB in the picture. This pro- 
coefficient Y. The red level R on the abscissa of FIG. 12 equal cessing from step ST73 up to step ST77 is repeated until the 
to 0 and MAX denote that there is no red area and that the first-path processing for all macro-blocks in the picture 
entire area of the macro-block MB is of red color, respec- comes to a close. 

lively. In general, deterioration in red color is readily per- As the processing from step ST73 up to step ST77, the 
ceptible to the human eye. Based on this feature, the relative coding difficulty dfl_mb of the mb_ith macro- 
coefficients Y is increased for the measure of a red area larger block is calculated as described above, 
than a pre-set value. At the next step ST74, the weighting coefficients weighl_ 
FIG. 13 shows characteristics of the relation between the mb, specifying the relative visibility of picture quality 
amount of the motion M of the macro-block MB and a deterioration taking into account the visual characteristics of 
function f4 of the coefficient 6. The amounts of motion M on the mb_ith macro-block MB, are calculated as explained 
the abscissa of FIG. 13 equal to 0 and MAX denote a still previously. 

picture and a picture showing maximum motion (fastest At the next step ST75, the relative complexity degree 

motion), respectively. In general, the human eye cannot x_mb of the mb__ith macro-block MB is calculated by 

follow the motion if a picture has fast motion, such that it muhiplying the relative coding difficulty dft_mb of the 

can hardly recognize picture deterioration. Based on this macro-block with the weighting coefficients weight_mb, as 

feature, the coefficient 0 is a smaU value not larger than 1 for shown by the equation (26): 
the larger value of the amount of motion M. 

no. 14 shows characteristics between weighting coeffi- xmb[mb_(\^dfi^b_i]*y.ei8hi[mb_(] (26) 
cients P in terms of numerical values specifying the degree 

of visibUity of deterioration and the position of the macro- ^t the next step ST76, the address of the macro-block MB 

block MB in the picture. In general, the human being tends advanced by one. That is, the above variable mb_i is 

to view the center of a picture, while deterioration in picture incremented by one. 

quality at picture edge portions is visible to a lesser extent. ^he step ST77, it is judged whether or not the process- 
Based on this feature, the weighting coefficients are of the last macro-block MB of the pict_ith picture has 
decreased radially from the picUire center. The coefficients e ^^"^^ ^ judged at this step ST77 that the 
are calculated from the following equation (26): processing has not come to a close, processing reverts to step 

55 ST73. If it is judged at this step ST77 that the processing has 
come to a close, processing transfers to processing of the 
next picture. 



e^f\x,yyiQ (25) 



The characteristic value calculating circuit 103 or 203 At step ST79, it is judged whether or not processing of the 

multiplies the coefficients a, p, y, B and e thus found by one last picture of the sequence (with the number of pictures 

another to find weighting coefficients weighl_mb of the 60 being NPCTT) has come to a close. If it is judged at this step 

macro-block MB. As for the ith macro-block MB, the ST79 that the processing has not come to a close, processing 

coefficients ai, pi, Yi, Qi and ei are found and multiplied by reverts to step ST72. If it is judged at this step 8179 that the 

one another as shown in the equation (24) to give the processing has come to a close, processing transfers to step 

weighting coefficients weight_mb of the ith macro-block ST80 to terminate the first path processing. 

MB. For calculating these weighting coefficients weighty 65 The second path processing shown in FIG. 16 is aimed at 

mb, one or more of the coefficients cxi, pi, yi, 6i and ei may calculating the quantization scale mQ of the macro-block 

also be used instead of using all of these coefficients. MB of the input moving picture signal. 
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At first step ST85 of FIG, 16, the learning parameter KQ 
is initialized. The initial value KQ[1] of the learning param- 
eter KQ is pertinent to the calculating conditions of the 
relative coding diflSculty of the macro-block. The learning 
parameter KQ is updated at the subsequent step ST92. 

At the next step ST86, the above variable pict_i is 
incremented for specifying the first picture among the pic- 
tures in the sequence as a picture processed by the second 
path processing. 

After this step ST86, the above variable pict_l is incre- 
mented each time the processing goes through the steps 
ST87 to ST97 for processing the macro-blocks MB in the 
picture for all macro-blocks MB in the picture. This pro- 
cessing from step ST87 up to step ST97 is repeated until the 
second-path processing for all macro-blocks in the picture 
comes to a close. 

At the first step ST87 in the processing from the step ST87 
up to step ST97, the volume of allocated bits BT of the 
pict_ith picture is calculated. That is, in the bit rale con- 
troller 104 or 204, the volume of the allocated bits of the 
GOP supplied from the terminal 108 is allocated by propor- 
tional distribution depending on the relative coding diflSculty 
of each picture. The relative encoding difficulty of the 
pict„ith picture is calculated from the sum total of the 
relative encoding difficulty of the pict_ith of the macro- 
blocks of the picture. 

At the first step ST88 in the processing from the next step 
ST88 to step ST94, the variable mb_i is set to 1 from 
designating the first macro-block MB in the picture as being 
a macro-block MB processed by the second path processing 
in the pict_ith picture. 

After this step ST88, the above variable mb__i is incre- 
mented by one in each step for processing each macro-block 
MB in the picture with the second-path processing. This 
processing from step ST89 up to step ST94 is repeated luitil 
the second-path processing for all macro-blocks in the 
picture comes to a close. 

By way of the processing from step ST89 up to step ST94, 
the volume of allocated hits targe t_bit_mb of the mu_iih 
macro-block is calculated first at step ST89 by the following 
equation (27): 

target_bit^bimb_i]-XA*x_mb[mb_i] (27) 

In the equation (27), XA is a constant parameter in the 
pict_ith picture calculated by the following equation (28) 

XA'BT/sum_jc_nib (28) 

In the above equation (28), the variable sum_x_mb is the 
sum total of the relative complexity degree x„mb of the 
macro-blocks in the pict_ith picture calculated by the 
first-path processing. This variable sum_x__mb is found by 
the following equation (29): 

jMm_jr_jnfc-2jr_4mfi'_J]Cmfe_*-l (o NMB) (29) 

At the next step S1^, the quantization scale mQ of the 
mb_ith macro-block MB is calculated by the following 
equation (30): 

mQ{mb_i\'K(^mb_iy(JCQ*XA *weight_fnb[mb_il) (30) 

In the above equation, KR is a coefficient pertinent to the 
target bit rate, while KQ[mb_i] is a learning parameter 
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which is updated at the subsequently step ST92 from one 

macro-block MB to another. 
At the next step ST91, the DCT coefficients of the mb_ith 

macro-block MB are quantized and encoded. This enables 
5 calculations of the actual volume of generated bits bit_mb 

[mb_i] in the mb_ith macro-block MB. 

At the next step ST92, the learning parameter KQ is 

updated. As learning parameters, KQ_I, KQ__P and KQ_B 

are provided for the I-, P- and B -pictures, respectively. 
10 These are updated by the equations (31), (32) and (33), 

respectively: 

KQ_J[mb_i+l]'KQ^l]+BG[mb_l]'BTMB[mb^'\ (31) 
KQ^mb^-i-l}'KQ^l'^BG[mb_l}BTMB[mb_(\ (32) 
KQ_B[mb_i+iyKQ^ 1 }^BG[mb_l}BTMB[mb_t] (33) 

In the above equations, KQ„I[1], KQ_P[1] and KQ_B 
20 [1] are initial values for the first macro-blocks MB of the I-, 
P- and B-pictures, respectively. On the other hand, BG[mb_ 
i] is a sum total of the volumes of generated encoding bits 
bit_mb as from the first macro-block MB up to the mb_its 
macro-block MB of a picture, as indicated in the following 
25 equation (34): 

BG[mb_i>.Zbit_mbImb_i] (I-l to mb_i) (34) 

whereas BTMB[mb_i] is a sum total of the volumes of 
allocated bits target_bit_mb as from the first macro-block 
MB up to the mb_ith macro-block MB of a picture, as 
indicated in the following equation (35) 

BTMB[inb_i]=5;iargct_bit_mb[i] (1=1 to mb_i) 

35 At the next step ST93, the address of the macro-block MB 
is advanced by one, that is, the above variable mb_l is 
incremented by one. 

At step ST94, it is judged whether or not processing of the 
last macro-block of the pict_ith picture has come to a close. 

*o If it is found at step ST94 that the processing has not come 
to a close, processing reverts to step ST89 and, if otherwise, 
processing transfers to step ST95 to increment the coeffi- 
cient pict_i by one to transfer to processing of the next 
picture. 

^5 Then, at step ST96, averaged values of the learning 
parameters KQ_I, KP_P and KQ_B of the picture on 
encoding the I-, P- or B-pictures are substituted for initial 
values KQ_I[1], KQ_P[1] and KQ_B[1] for the next 
pictures of the same picture types, respectively. This sub- 

50 stitution is by the following equations (36), (37) and (38): 

KQ_I(l)-(5:KQ_I[i])/NMB (1-2 to mb„i+l) (36) 
KQ_P(l)=(2:KQ_P(i))/NMB (1-2 to mb_i+l) (37) 
55 KQ_BCl)-(IKCI_B(i))/NMB (1=2 to mb_i+l) (38) 

At the next step ST97, it is judged whether or not 
processing of the last picture of the sequence (with the 
number of pictures equal to NPICT) has come to a close. If 

60 it is found at step ST97 that the processing has not come to 
a close, processing reverts to step ST87 and, if otherwise, 
processing transfers to step ST98 to terminate the processing 
of the second-path bit rate control. 
The amount of delay between the above-mentioned first 

65 and second paths is preferably not less than 1 GOP. For 
providing this time delay, the delay circuit 102 of FIG, 5 or 
the delay circuit 102 of FIG. 9 is used. If all picmres of the 



07/22/2004, EAST Version: 1.4.1 



6,167, 

15 

sequence are encoded as I-pictures, one-picture time suffices 
as the amount of delay between the first and second paths. 
On the other hand, if the number of the pictures in a 
sequence NPCT=1, a still picture is encoded as an I-picture, 
so that one picture suffices as the amount of delay between 5 
the first and second paths. 

The encoded bitstream, obtained by encoding by the first 
and second embodiments of the picture signal encoding 
device, is recorded on a signal recording medium according 
to the present invention or transmitted over a transmission lo 
channel. 

FIGS. 5 and 9 show examples of using an optical disc 704 
as a signal recording medium for recording or transmission 
over a transmission channel. 

In case of recording on the optical disc 704 in FIGS. 5 or 15 
9, a data stream composed of an encoded bitstream outputted 
at the output terminal 106 and the information necessary for 
subsequent decoding, such as the quantization scale, is 
added to an error correction code by an error correction 
encoder (ECC encoder) 701 before being sent to a modu- 20 
lation circuit 702. The modulation circuit 702 processes the 
output of the error correction encoder 701 with pre-set 
modulation, such as so-called 8-14 (eight-to -fourteen modu- 
lation or EFM) or 8-16 modulation. By this modulation, the 
encoded 8-bit data are converted to 14 or 16 bit data for 25 
matching the digital signals to transmission characteristics 
for the optical disc 704. An output of the modulation circuit 
702 is sent to a recording head 703 where it is recorded on 
the optical disc 704. Although the optical disc is used as a 
signal recording medium in the examples of FIGS. 5 and 9, 30 
the recording medium may also be a magnetic disc medium, 
such as a hard disc or a flexible disc, a tape -shaped recording 
medium, an IC card or a semiconductor memory, such as 
various memory devices. As an optical disc, a variety of 
optical discs, such as a phase transition type optical disc, an 35 
organic dye type optical disc, an optical disc for recording by 
UV laser light beam or an optical disc having a multi-layer 
recording film, may be used besides the disc for recording by 
physically forming pits, or a magneto-opiiuai disc. 

For transmission over a transmission channel, the above- 40 
mentioned data string is added to with an error correction 
code by an error correction encoder 711 and thence trans- 
mitted over the transmission chaimel via interfacing circuit 
712 and a terminal 713. The transmission channel also 
includes electric waves or light in addition to the usual 45 
transmission cable.. 

For controlling the quantization scale for quantizing data 
of a macro-block MB in the above-described picture signal 
encoding method and apparatus of the present invention, a 
volume of bits allocated to a picture is received, calculations 50 
are then made of the relative complexity degree of all 
macro-blocks MB of the picture, and the quantization scale 
of the macro-blocks is calculated taking into account the 
volume of allocated bits necessary for each macro-block of 
the picture. 55 

Ttais, if the picture pattern is not uniform, as when the 
contents of the upper half and the lower half of a picture 
differ from each other such that the upper half picture is 
simple in picture pattern and the lower half picliu-e is 
complex in picture pattern, the volume of bits necessary for 60 
the upper half picture and that necessary for the lower half 
picture can be adaptively allocated for calculating optimum 
quantization scale, thus enabling the picture to be encoded 
with higher picture quality than is possible with the con- 
ventional method. 65 

Moreover, in calculating the complexity degree of all 
macro-blocks of a picture in advance as described above, the 
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relative complexity degree for each macro-block MB of a 
picture is calculated from the relative coding difficulty and 
the weighting coefficients representing the variable visibility 
degree of picture quality deterioration. Specifically, the 
relative coding difficulty of the macro-block MB is calcu- 
lated using the volume of bits generated on encoding the 
macro-block with a fixed quantization scale, the volume of 
prediction residual signal on detecting the motion vector of 
the macro-block MB or the difference residual volume from 
the mean value, of the macro-block MB, while the weighting 
coefficients representing the variable visibility degree of 
picture quality deterioration of the macro-block MB is 
calculated using at least one of lightness, red level, amount 
of motion and the position of the macro-block MB in the 
picture, in addition to flatness of the luminance signals. This 
enables encoding with less visibility of the deterioration in 
picture quality than is possible with the conventional 
method. 

Also, in calculating the quantization scale of the macro- 
block MB taking into account the amount of allocated bits 
required for each macro-block MB of each picture, the 
volume of bits allocated to each macro-block is calculated so 
that the allocated bit volume will be proportionate to the 
variable complexity degree of each macro-block relative to 
the complexity degree of the entire picture. This enables 
extremely flexible designation of the weighting coefficients 
representing the variable visibihty degree of picture contra- 
distinction from the conventional system, there is no neces- 
sity for normalization so that the expected value of the 
weighting coefficients for one picture will be equal to 1. 

In addition, in the picture signal encoding method and 
apparatus embodying the invention, there is presented no 
such problem that, if the quantization scale mQ indicated by 
reference numerals entered in each macro-block MB in FIG. 
17 has been calculated, and the weighting coefficients of 
macro-blocks shown shaded in FIG. 17 are increased with a 
view to reducing the quantization scale of the shaded 
macro-blocks MB, only the values of the quantization scale 
calculated for the macro-blocks MB downstream of the 
shaded macro-blocks are increased, as in the case shown in 
FIG. 4. This assures stabilized bit rate control as compared 
to that achieved with the above-mentioned prior-art method. 

Thus, when encoding a picture corresponding to moving 
picture signals by dividing the picture into plural domains 
(MB) and encoding the picture from domain to domain, the 
picture quality can be rendered substantially uniform even if 
the picture pattern is not uniform by calculating the relative 
coding difficulty from one domain (MB) to another and the 
weighting coefficients representing the visibility degree of 
picture quality deterioration from oue domain to another, 
calculating the complexity degree from the relative coding 
difficulty and the weighting coefficients from one domain to 
another and by calculating the quantization scale for encod- 
ing each domain using the allocated bit volumes for picture 
encoding and the above-mentioned complexity degree. In 
addition, the volume of bits occupying a virtual buffer can 
be stabilized to render picture quality deterioration less 
visible while assuring stabilized rate control. 

What is claimed is: 

1. A method for encoding picture signals in which moving 
picture signals are divided into plural macroblocks for 
encoding from one macroblock to another, comprising the 
steps of: 

calculating relative coding difficulty from macroblock to 
macroblock; 

calculating for each macroblock weighting coefficients 
representing a respective degree of visibility of picture 
quality deterioration; 
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calculating a complexity degree from macroblock to 14. The apparatus as claimed in claim 13 wherein said 

macroblock, based on the relative coding diflQculty and quantization scale calculating means calculates the allocated 

the weighting coeflScients; and bit volumes for the macroblocks based on the complexity 

calculating the quantization scale for encoding for the degree of the macroblocks relative to the complexity degree 
macroblocks based on the complexity degree and alio- 5 of entire picture. 

cated bit volumes for encoding the macroblocks. 15. The apparatus as claimed in claim 13 wherein said 

2. The method as claimed in claim 1 wherein the allocated relative coding dilEculty calculating means calculate the 
bit volumes for encoding the macroblocks are calculated relative coding difficulty based on the volume of codes 
based on the complexity degree of the macroblocks relative generated on encoding each macroblock with a fixed quan- 
to the complexity degree of the entire picture. tization scale. 

3. The method as claimed in claim 1 wherein said relative 16. The apparatus as claimed in claim 13 wherein said 
coding difficuhy is calculated based on the volume of codes relative coding difficulty calculating means calculates said 
generated on encoding each macroblock with a fixed quan- relative coding difficulty based on the volume of predicted 
tization scale. remainder signals at the time of detecting the motion vector 

4. The method as claimed in claim 1 wherein said relative of each macroblock. 

coding difficulty is calculated based on the volume of 17. The apparatus as claimed in claim 13 wherein said 

predicted remainder signals at the time of detecting the relative coding difficulty calculating means calculates said 

motion vector of each macroblock. relative coding difficulty based on the difference residual 

5. The method as claimed in claim 1 wherein said relative volume from a mean value of each macroblock. 

coding difficulty is calculated based on the difference 18. The apparatus as claimed in claim 13 wherein said 

residual volume from a mean value of each macroblock. weighting coefficient calculating means calculates the 

6. The method as claimed in claim 1 wherein said weighting coefficients based on the lightness and flatness of 
weighting coefficients are calculated based on the lightness luminance signals of said moving picture. 

and flatness of luminance signals of said moving picture. 19. The apparatus as claimed in claim 13 wherein said 

7. The method as claimed in claim 1 wherein said weighting coefficient calculating means calculates the 
weighting coefficients are calculated based on the redness weighting coefficients are calculated based on the redness 
and flatness of luminance signals of said moving picture, and flatness of luminance signals of said moving picture. 

8. The method as claimed in claim 1 wherein said 20. The apparatus as claimed in claim 13 wherein said 
weighting coefficients are calculated based on the flatness weighting coefficient calculating means calculates the 
and the amount of motion of luminance signals of said weighting coefficients based on the flatness and the amount 
moving picture. of motion luminance signals of said moving picture. 

9. The method as claimed in claim 1 wherein said 21. The apparatus as claimed in claim 13 wherein said 
weighting coefficients are calculated based on the flatness of weighting coefficient calculating means calculates the 
the luminance signals of the moving picture signals and the weighting coefficients based on the flatness of the luminance 
position of each macroblock in the picture. signals of the moving picture signals and the position of each 

10. The method as claimed in claim 1 wherein said macroblock in the picture. 

weighting coefficients are calculated based on the combina- 22. The apparatus as claimed in claim 13 wherein said 

tion of two or more of the lightness, redness, amount of weighting coefficient calculating means calculates the 

motion and the position of each macroblock in the picture. weighting coefficients based on the combination of two or 

in addition to the flatness of the luminance signals of the more of the lightness, redness, amount of motion and the 

moving picture. position of each macroblock in the picture, in addition to the 

11. The method as claimed in claim 1 further comprising flatness of the luminance signals of the moving picture, 
the step of: 23. The apparatus as claimed in claim 13 further com- 

encoding the moving picture signals based on said quan- prising: 

tization scale for generating an encoded data string and transmission means for transmitting the resulting encoded 

transmitting the resulting encoded data string. data string. 

12. The method as claimed in claim 1 further comprising 24. The apparatus as claimed in claim 13 further com- 
the step of: prising: 

encoding the moving picture signals based on said quan- recording means for recording an encoded data string, 

tization scale for generating an encoded data string and jg obtained on encoding said moving picture signals 

recording the resulting encoded data string on a record- based on the quantization scale, on a recording 

ing medium. medium. 

13. An apparatus for encoding picture signals in which a 25. A recording medium having recorded thereon an 
picture constituting moving picture signals is divided into encoded data string obtained by calculating, for each plural 
plural macroblocks for encoding from one macroblock to 55 macroblocks into which is divided a picture making up 
another, comprising: moving picture signals, the relative coding difficulty and 

means for calculating relative coding difficulty from mac- weighting coefficients representing the visibility degree of 

roblock to macroblock; picture quality deterioration; 

means for calculating for each macroblock weighting calculating the complexity degree from said relative cod- 
coefficients representing a respective degree of visibil- 60 difficulty and the weighting coefficients; 
ity of picture quality deterioration; and calculating the quantization scale of encoding for each 

means for calculating a complexity degree from macrob- macroblock based on the volume of allocated bits for 

lock to macroblock, based on the relative coding dif- encoding each macroblock and complexity degree; and 

ficulty and the weighting coefficients, and calculating encoding each macroblock based on said quantization 

the quantization scale for encoding for the macroblocks 65 scale. 

based on the complexity degree and allocated bit vol- 26. The recording medium as claimed in claim 25 wherein 

umes for encoding the domains. the allocated bit volumes for encoding the macroblocks are 



07/22/2004, EAST Version: 1.4.1 



6,167,087 

19 20 

calculated based on the complexity degree of the macrob- 38. The transmission channel as claimed in claim 37 

locks relative to the complexity degree of the entire picture. wherein the allocated bit volumes for encoding the macrob- 

27. The recording medium as claimed in claim 25 wherein locks are calculated based on the complexity degree of the 
said relative coding difficulty is calculated based on the ^acroblocks relative to the complexity degree of the entire 
volume of codes generated on encodmg each macroblock 5 picture 

with a fixed quantization scale. an -n. . ■ • i_ 1 1 • j • 1 • 

28. The recording medium as claimed in claim 25 wherein transmission chamiel as clamied in claim 37 
said relative coding difficulty is calculated based on the wherem said relative codmg difficulty is calculated based on 
volume of predicted remainder signals at the time of detect- volume of codes generated on encoding each macrob- 
ing the motion vector of each macroblock. lock with a fixed quantization scale. 

29. The recording medium as claimed in claim 25 wherein 40. The transmission channel as claimed in claim 37 
said relative coding difficulty is calculated based on the wherein said relative coding difficulty is calculated based on 
difference residual volume from a mean value of each the volume of predicted remainder signals at the time of 
macroblock. detecting the motion vector of each macroblock. 

30. The recording medium as claimed in claim 25 wherein 41. The transmission channel as claimed in claim 37 
said weighting coefficients are calculated based on the wherein said relative coding difficulty is calculated based on 
Hghtness and flatness of luminance signals of said moving the difference residual volume from a mean value of each 
P^^ture. macroblock. 

31. m recording medium as claimed m claim 25 wherein 43. The transmission channel as claimed in claim 37 
said weighting coefficients are calculated based on the ^^^^^^ weighting coefficients are calculated based on 
redness and flatness of luminance signals of said moving 20 ^-^^^^^^^ ^^^^^^ luminance signals of said 

32. The recording medium as claimed in claim 25 wherein mo>angpicture. 

said weighting coefficients are calculated based on the 43. The transmission channel as claimed in claim 37 

flatness and the amount of motion of luminance signals of ^'"^ weightmg coefBcients are calculated based on 

said moving picture. 25 redness and flatness of luminance signals of said moving 

33. The recording medium as claimed in claim 25 wherein picture. 

said weighting coefficients are calculated based on the ^ transmission channel as claimed in claim 37 

flatness of the luminance signals of the moving picture wherein said weighting coefficients are calculated based on 

signals and the position of each macroblock in the picture. the flatness and the amount of motion of luminance signals 

34. The recording medium as claimed in claim 25 wherein of said moving picture. 

said weighting coefficients are calculated based on the 45. The transmission channel as claimed in claim 37 

combination of two or more of the lightness, redness, wherein said weighting coefficients are calculated based on 

amount of motion and the position of each macroblock in the the flatness of the luminance signals of the moving picture 

picture, in addition to the flatness of the luminance signals signals and the position of each macroblock in the picture, 

of the moving picture. 46. The transmission channel as claimed in claim 37 

35. The recording medium as claimed in claim 25 further wherein said weighting coefficients are calculated based on 
comprising the step of: the combination of two or more of the lightness, redness, 

encoding the moving picture signals based on said quan- amount of motion and the position of each macroblock in the 

tization scale for generating an encoded data string and picture, in addition to the flatness of the luminance signals 

transmitting the resulting encoded data string. of the moving picture. 

36. The recording medium as claimed in claim 25 further 47. The transmission channel as claimed in claim 37 
comprising the step of: further comprising the step of: 

encoding the moving picture signals based on said quan- encoding the moving picture signals based on said quan- 
tization scale for generating an encoded data string and tization scale for generating an encoded data string and 
recording the resulting encoded data string on a record- transmitting the resulting encoded data string, 
ing medium. 48, The transmission channel as claimed in claim 37 

37. A transmission channel having transmitted thereover further comprising the step of: 

an encoded data string obtained by calculating, for each encoding the moving picture signals based on said ouan- 

plural macroblocks mto which is divided a nictijre taking up tization scale for generating an encoded data string and 

movmg picture signals, the relative codmg difficulty and recording the resulting encoded data string on a record- 

weightmg coefficients representmg the visibility degree of jj^g (uedium 

picture quality deterioration; 49 transmission channel as claimed in claim 37, 

calculating the complexity degree from said relative cod- wherein the transmission channel is electric waves. 

ing difficulty and the weighting coefficients; 50. The transmission channel as claimed in claim 37, 
calculating the quantization scale of encoding for each 55 wherein the transmission channel is light. 

macroblock based on the volume of allocated bits for 51. The transmission channel as claimed in claim 37, 

encoding each macroblock and complexity degree; and wherein the transmission channel is a transmission cable, 
encoding each macroblock based on said quantization 

scale. ♦ * ♦ ♦ ♦ 
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